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ON FINITE RANK HANKEL OPERATORS 

D. R. YAFAEV 



(^ , Abstract. For self-adjoint Hankel operators of finite rank, we find an explicit 

Cn ' formula for the total multiplicity of their negative and positive spectra. We 

\—i , also show that very strong perturbations, for example, a perturbation by the 

Carleman operator, do not change the total number of negative eigenvalues of 

finite rank Hankel operators. 



< 

[i^ ; 1. Introduction. Main results 



1.1. Hankel operators can be defined as integral operators 

iHf)it)= / hit + s)fis)ds (1.1) 

Jo 



in the space L (R+) with kernels h that depend on the sum of variables only. Of 
f^ . course H is symmetric if h{t) = h(t). 

C^ \ Integral kernels of self-adjoint Hankel operators H of finite rank are given (this 

is the Kronecker theorem - see, e.g., Sections 1.3 and 1.8 of the book [6J) by the 

formula 

M 



> 

\D 
(N 

^' 

m' /i(t) = VP™(t)e-"'"* (1.2) 

—i ' ' ' 

m=l 

where Rea^ > and Pm{t) are polynomials of degree Km- If H is self-adjoint, 

^ i then necessarily the sum in (II. 2p contains both exponentials e""™* and e~"™*. 

^ I Let ImOm = for m = 1,...,Mq, Ima^ > and aMi+m = «m for m = 

■ ■ ■' Mo + 1, . . . , Mo -I- Ml. Thus M = Mo + 2Mi; of course the cases Mq = or Mi = 

are not excluded. The condition h(t) = h{t) requires also that Pm{t) = Pm{t) for 

m = 1, . . . , Mo and Pivh+mit) = PJt) for m = Mo + 1, • • • , Mq + Mi. As is well 

known and as we shall see below, 



M 
m=l 



rank H =^Km + M 
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2 D. R. YAFAEV 

For m = 1, . . . , Mo, we set 

?^ = pL^-\ (1-3) 

that is, Pm/Km^. is the coefficient at t^™ in the polynomial Pm{t), and 

ATJ'") = ATI™) = (ir^ + l)/2 if i^^ is odd ] 

ATJ™) - 1 = TVl™^ = ir„/2 if K^ is even and p„ > > (1.4) 

TVJ™) = ATi:'"^ - 1 = ir„/2 if K^ is even and p„ < 0. J 

For a self-adjoint operator A, we denote by A^+(A) (by N„{A)) the total muti- 
plicity of its strictly positive (negative) spectrum. Our main result is formulated 
as follows. 

Theorem 1.1. Let H be the self-adjoint Hankel operator of finite rank with kernel 
h(t) given by formula f 1 1.21) where Pm{t) ol'^^ polynomials of degree Km, and let 
the numbers A/"], be defined by formula ( 11. 4p . Then the total numbers N±(H) 
of {strictly) positive and negative eigenvalues of the operator H are given by the 
formula 

Mo A/o+A/i 

N^iH) = Y,^t^+ E ^rn + M^. (1.5) 

m=l m=Mo + l 

Formula (11.51) shows that every pair of complex conjugate terms 



P™(t)e-"'"* + P^(t)e-"-*, m = Mo + 1, . . . , Mo + Ml, (1.6) 

in representation (11.21) of h{t) yields Km + l positive and K^ + l negative eigenval- 
ues. In view of (ll.4p the contribution of every real term Pm(t)e~°'"'* also consists 
of the equal numbers {Km + 1)/2 of positive and negative eigenvalues if the degree 
Km of Pm{t) is odd. If Km is even, then there is one extra positive (negative) 
eigenvalue if Pm "" > {Pm < 0). In particular, in the question considered, 
there is no "interference" between different real terms Pm(^)e~"™*, m = 1, . . . , Mo, 
and pairs (II. 6p . 

According to (11.51) the operator H cannot be sign-definite if Mi > 0. Moreover, 
according to (II. 4p the operator H cannot be sign-definite if Km > at least for 
one 771 = 1, ... , Mo. Therefore we have the following result. 

Corollary 1.2. A Hankel operator H of finite rank in the space L^(]R_|_) is positive 
{negative) if and only if its kernel is given by the formula 

Mo 

ami 



h{t) = ^ pme 



m=l 



where am > and p^ > (p^ < 0). 
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Let us recall the paper [4j by A. V. Megretskii, V. V. Peller, and S. R. Treil. In 
the particular case of finite rank Hankel operators if, it follows from the results of 
[1] that the spectra of H are characterized by the condition that the multiplicities 
of eigenvalues A and —A do not differ by more than 1. Compared to Theorem ll.il 
this result is of a completely different nature. 

1.2. The result of Theorem 11.11 turns out to be stable under a large class of 
perturbations of finite rank Hankel operators. As an example, we consider the 
sum H = Hq + V oi the Carleman operator Hq, that is, of the Hankel operator 
with kernel /lo(^) = ^~^; and of a finite rank Hankel operator V . Recall that the 
Carleman operator has the absolutely continuous spectrum [0, vr] of multiplicity 
2. We obtain the following result. 

Theorem 1.3. Let Hq be the Hankel operator with kernel /io(^) = t~^ . If V is a 
Hankel operator of finite rank and H = Hq + V , then 

N_{H) = N^{y). 

In particular, H > if and only ifV > 0. 

The inequality N_{H) < N_{V) is of course obvious because Hq > 0. On the 
contrary, the opposite inequality N_{H) > N_(y) looks surprising because the 
Carleman operator is "much stronger" than V; it is not even compact. Never- 
theless its adding does not change the total number of negative eigenvalues. 

It is natural to compare (this point of view goes back to J. S. Howland [2]) 
Hankel operators H with "perturbed" kernels h{t) = t^^ + v{t) to Schrodinger 
operators D'^ + V(x). The assumption that v(t) decays sufficiently rapidly as 
t — !■ oo and is not too singular as t — )■ corresponds to a sufficiently rapid decay 
of a potential V(x) as \x\ -^ oo. As shown in [9], the results on the discrete 
spectrum of the operator H lying above its essential spectrum [0, vr] are close 
in spirit to the results on the discrete (negative) spectrum of the Schrodinger 
operator D^ + V(x). On the contrary, according to Theorem 11.31 the results on 
the negative spectrum of Hankel operators are drastically different from those for 
the Schrodinger operators. 

1.3. Our proofs of Theorems II. II and II. 3l rely on the approach suggested in [10] . 
It is shown in [lOJ that a Hankel operator H has the same numbers of negative 
and positive eigenvalues as an operator 5* of multiplication by some function s{x). 
In particular, ±H > if and only if ±5* > 0. Therefore we use the term "sign- 
function" for s{x). In specific examples functions s{x) may be of a quite different 
nature. For instance, for finite rank Hankel operators, s{x) is a distribution which 
is an explicit combination of delta functions and their derivatives. This allows 
us to calculate the total numbers of negative and positive eigenvalues of such 
operators and thus prove Theorem 11.11 
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As far as Theorem 11.31 is concerned, we note that the sign-function of the 
Carleman operator equals 1. Its support is essentially disjoint from supports of 
the sign-functions of finite rank Hankel operators V. Very loosely speaking, it 
means that the operators Hq and V "live in orthogonal subspaces", and hence 
the positive operator Hq does not affect the negative spectrum oi H = Hq + V . 

We note that since the sign-function is, in general, a distribution, S need not 
be defined as an operator. Therefore we work with quadratic forms which is both 
more general and more convenient. 

Roughly speaking, the approach of |10j can be described as follows. Let S be 
the formal operator of multiplication by the function s{x). Then the identity 

H = E*SE (1.7) 

holds with some invertible operator S. It follows that 

N^{H) = N^{S). (1.8) 

For finite rank Hankel operators H, the form {Su, u) is determined by values 
of functions u{x) and their derivatives at some finite number of points. Therefore 
number (II. 8p equals iV±(S) for some Hermitian matrix S (the sign-matrix of the 
operator H) constructed in terms of s{x). It turns out that the matrix S has a 
very special structure which allows us to calculate the number N±{S) explicitly. 

1.4. Let us briefly describe the structure of the paper. We collect necessary 
results of [Tpj in Section 2. Proofs of Theorems 11.11 and 11.31 are given in Section 3. 
Hankel operators can be standardly realized not only in L^(]R+) but also in the 
Hardy spaces EI^(]R), EI^(T) and in the space of sequences /^(Z_(.). The interre- 
lations between different representations are discussed in the auxiliary Section 4. 
This information is used in Section 5 to reformulate Theorems 11.11 and 11.31 in the 
spaces EI^(M), E[^(T) and /^(Z+). Finally, in the Appendix we describe the group 
of automorphisms of the set of Hankel operators in all these spaces as well as in 
the space L^(R+). 

Let us introduce some standard notation. We first recall that T is the unit 
circle in the complex plane and Z+ is the set of all nonnegative integers. We 
denote by $, 

($m)(^) = (27r)"i/2 / ^(a;)e-»5rf, 



the Fourier transform. The space Z = Z{M.) of test functions is defined as the 
subset of the Schwartz space S = S{R) which consists of functions ip admitting the 
analytic continuation to entire functions in the complex plane C and satisfying, 

for all 2; G C, bounds 

l¥^(^)|<a(l + kl)-"e^l'"^^l 
for some r = r{(f) > and all n. We recall that the Fourier transform $ : .E — >■ 

Co°°(M) and $* : C^{R) -^ Z. 
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The dual classes of distributions (continuous antilinear functionals) are denoted 
S', C^(R)' and Z', respectively. We use the notation (-, ■) and (■, ■) for the duality 
symbols in L^(M+) and L^(M), respectively. They are linear in the first argument 
and antilinear in the second argument. 

The Dirac function is standardly denoted 6{-); 6n,m is the Kronecker symbol, 
i.e., 6n,n = 1 and 6n,m = if n 7^ m. The letter C (sometimes with indices) 
denotes various positive constants whose precise values are inessential. 

2. The sign-function 

Here we briefly discuss necessary results of [lOj adapting them to the case of 
bounded Hankel operators. 

2.1. Let us consider a Hankel operator H defined by equality (II. ip in the space 
L^(]R_i_). Actually, it is more convenient to work with sesquilinear forms instead 
of operators. Let us introduce the Laplace convolution 

ft 



(/l^/2)(t)= / f,{s)f2{t-s)ds (2.1) 

of functions /i and /2. Then 

(Hf,j2) = {hJ,^f,)=:h[hJ,] (2.2) 

where we write (■, ■) instead of (■, ■) because h may be a distribution. 

We consider form (12. 2p on elements /i, /2 G ^ where V is defined as follows. 
Put 

{Uf){x) = e-/'f{en. 
Then U : L^(M+) — )■ L^(M) is the unitary operator. The set P consists of functions 
f{t) such that Uf G Z. Since 

f{t)=t~'/\Umnt) 

and Z G S,we see that functions f eT) and their derivatives satisfy the estimates 

for all n and m. Of course, V is dense in the space L^(]R_|_). It is shown in [10] 
that if /i, /2 G 15, then the function 

belongs to the set Z. 

With respect to h, we assume that the distribution 

e{x) = e"/i(e") (2.3) 

is an element of the space Z'. The set of all such h will be denoted 2^^, that is, 

hez'^^eez'. 
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It is shown in ^0\ that this condition is satisfied for all bounded Hankel operators 
H. Since Q & Z, the form 



{h,fi*f2) = / h{t)ih^f2mdt= / e{x)Q{x)dx =: {e,Q) 

Jo J -oo 

is correctly defined. 

Note that h e Z'^ if h e LJq^(M+) and the integral 

\h{t)\{l + \lnt\)-''dt<oo 

converges for some k. In this case the corresponding function fl2.3p satisfies the 
condition 



/oo 
\e{x)\{l + \x\)-''dx<oo, 
-oo 



and hence 6 E S' G Z' . 



2.2. Let us now give the definition of the sign-function of a Hankel operator 
H or of its kernel h{t). Set 



Of course &(— = ^(0 if h(t) = h{t). We call 6(^) the 6-function of a Hankel 
operator H (or of its kernel h{t)) and we use the term the sign-function for the 
Fourier transform s{x) = v^27r($*6)(x) of b{^). 

Let the function 6{C,) be defined by formula (12.31) . If /i G Z'_^, then 9 E Z' and 
hence its Fourier transform 

^oo 

a(0 = imH) = (27r)-^/^ / h{t)t'^^dt (2.5) 



is an element of C^(M)'. Then definition (12. 4p can be rewritten 

h{i) = {2n)-'l'a{i)T{l-ii)-' (2.6) 

where r(-) is the gamma function. Note that r(l — i,^)"^ 7^ for ^ G M, but 
according to the Stirling formula it tends exponentially to zero as |^| — t- 00. 
Nevertheless the distribution h G C^(M)' and hence s G Z' . 
For a test function / G P, we set 

^(0 = r(l/2 + lOmfm =: (H/)0. (2.7) 

Since Uf G Z, the functions ^Uf G C^(M) and hence g G C^(M). We note that 
($[//) (^) is the Mellin transform of f{t). 
The following result was obtained in |10] . 
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Theorem 2.1. Suppose that h G Z'_^. Define the distribution h G C^(]R)' hy 
formula (12.41) . and set s = ^/27l^*b G Z' . Let fj G T), j = 1, 2, let the functions 
Qj G C^(M) he defined hy formula ( 12^]) and Uj = ^*gj = ^*Efj G Z. Then the 
identity 

(h, /i * /2) = {s, U1U2) =: s[ui, U2] (2.8) 

holds. 

2.3. For an arbitrary distribution h G Z'^, we have constructed in Theorem 12. II 
its sign-function s G Z'. It turns out that, conversely, the kernel h{t) can be 
recovered from its sign-function s{x). 

Proposition 2.2. Let h G Z'j^, and let s & Z' be its sign-function. Then 

/■oo 

h{t) = / e-*"~"e-^s(x)rfx. (2.9) 



As we shall see in the next section, even for kernels (II. 2p . the corresponding 
sign- function s{x) is a highly singular distribution. Nevertheless the mapping 
h{t) -H- s{x) yields the one-to-one correspondence between the classes Z'^ and Z'. 
We emphasize that formula (12.91) is understood in the sense of distributions. 



2.4. Suppose now that h{t) = h{t) so that the operator H is self-adjoint. Then 
the identity (12. Sp . or equivalently (II. 7p . implies relation (II. 8p . To be more precise, 
we use the following natural definition. Denote by A^±(s) the maximal dimension 
of linear sets C± C Z such that ±s['U,-u] > for all u G C±, -u 7^ 0. We apply 
the same definition to the form h[f, f] considered on the set V and observe that 
N±{h) = N±{H). 

Note that formula (12. 7p establishes one-to-one correspondence between the sets 
V and C^(M). Of course the Fourier transform establishes one-to-one correspon- 
dence between the sets C^(M) and Z. Therefore the following assertion is a 
direct consequence of Theorem 12.11 

Theorem 2.3. Let a Hankel operator H he hounded. Define the distribution 
b G C^(M)' hy formula (EID and set s = y/2TT^*b G Z' . Then 

N^{H)=N^{s). (2.10) 

In particular, relation (I2.10p means that a Hankel operator H is positive (or 
negative) if and only if the function s{x) is positive (or negative). This justifies 
the term "sign-function" for s{x). 

3. Proofs of Theorems [LT] and [L3] 
3.1. Let us first calculate the b- and s-functions of the kernel 

h{t) = t'^e""* where /c = 0, 1, . . . , Re a > 0, (3.1) 
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but we do not assume that Ima = 0. Calculating integral f l2.5p we see that 

Jo 
where arga G (— 7r/2, 7r/2), and hence function (12 .Gp equals 

^^> " 27rr(l-^0 

Since k is integer, this yields the following result. 

Lemma 3.1. Let h{t) be given by formula (13. ip . If k = 0, then b{C,) = 
(27r)-ia-i+*« and 

s{x) = a^H{x - /3), /3 = - In a. (3.2) 

If k = 1,2, .. ., then 

bi^) = i2n)-'a-'-'^^^il-^0■■■ik-^0 

and 

s{x) = a-^-'^il -d)---{k- d)5{x - /3). (3.3) 

Let us use the notation v^^k for the coefficients of the expansion 

k 

{I- z)---{k- z) = ^Vi^kZ^ 

e=o 

ioT k > 1, i < k, and set z/o,o = 1- Then formulas (13. 2p and (13. 3p can be rewritten 

as 

k 

s[x) = a 

e=o 
Therefore Lemma [3.11 implies the following more general result. 

Lemma 3.2. Let 

h{t) = P(t)e-"* (3.4) 

where Re a > and 

K 

Pit) = Y,Pkt' (3.5) 

k=0 

is a polynomial. Set 

K 

(!k = ^ Uk,ia~^~^Pe; (3.6) 

e=k 
in particular, qx = {—l)^a~^~^pK- Then the b- and s-functions of kernel (13. 4p 
equal 

K 

6(0 = (27r)- V-'^Q(x) where Q(0 = ^^^^.(^O', (3-7) 

fc=0 



-i-'=5;]^,,,<5W(x-/3). 
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(3 = —Ina, and 

K 

s{x) = Y,(lkS^'\^-(3)- (3.8) 

Observe that distribution fl3.8p is positive if and only if Ini/3 = 0, g^ = for all 
k > 1 and go > 0. Therefore the Hankel operator with kernel (13.41) . (13. 5p cannot 
be expected to be sign-definite unless a is real and K = 0. Theorem 11.11 provides 
essentially more advanced results in this direction. 

Note that for u & Z 

k 

(5^ (x - (3) \u{x)\^dx = (-1)^ Y, ^kU^'^ {P)u^^-^){^) 

' £=0 

where C^ are the binomial coefficients. This leads to the following result. 
Lemma 3.3. For the distribution given by formula (13. Sp . we have 

K 

(s,|wr) = 5^s,y^)(/3)^I(^, ueZ, 

j,i=0 

where Sj^£ = for j + £ > K and 

s,,,= {-iy^'C]^fi,^, (3.9) 

for j + i < K; in particular, 

s,^, = {-!)'' CUk for j+£ = K. 

It is now convenient to introduce 

Definition 3.4. Let a kernel h{t) be given by formulas (13. 4p . (13. Sp . and let qk be 
coefficients (13. 6p . Denote by S the matrix of order K + 1 with the elements Sj^i 
defined in Lemma [3.31 We call S = S(P, a) the sign-matrix of the kernel h{t). 

It is only essential for our proof of Theorem 11.11 that the sign-matrix S is skew 
triangular, that is, Sj/ = for j + d > K, and that its elements Sj^ = Cj^a~^~^pK 
on the skew-diagonal j + i = K are not zeros if px 7^ 0. In this case Det S 7^ 0. 
Note also that 

S(P,a) = S(P,a)*; (3.10) 



in particular, S(P, a) is symmetric if a = a and P(t) = P(t). 
Let us define the mapping Jk{(3) '■ Z — )■ C^+^ by the relationu 

J^(/3)m = (m(/3), n'(/3), . . . , nW(/3))^. (3.11) 

Then Lemma [3.31 yields the following assertion. 



The upper index "T" means that a vector is regarded as a column. 
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Proposition 3.5. For a kernel h{t) defined by ( 13. 4p . fl3.5p . the sign-function is 
given by the formula 

{s, \u\^) = (S(P, a)JKW)u, MI3)u)k+u /3 = - In a, (3.12) 

where (■, ■)k+i is the scalar product in C^"*"^. 

Formula (13.121) is convenient for real a and P{t). In the complex case, we 
consider the real kernel 



h{t) = P(t)e"°* + P(t)e"^*, Rea > 0, Ima > 0, (3.13) 

corresponding to two complex conjugate points a and a. It follows from Propo- 
sition 13.51 that the corresponding sign- function equals 

(s, \u\^) = (S(P, a)JK{/3)u, Jk{(3)u)k+i + (S(P, a)JK{(3)u, Jk{I3)u)k+i. 

Let us rewrite this equality in the "matrix" form taking into account relation 

Proposition 3.6. For a kernel h{t) defined by (13. 5p . (13.131) . the sign-function is 
given by the formula 

{s, \u\') = (S(P, a){MP)u, JkW)uV, {JkW)u, JK{P)uy)2K+2, f3 = -\na, 
where 

Let us now consider kernel (II. 2p . We can apply Proposition 13.51 to all real terms 
corresponding to m = 1, . . . , Mq and Proposition 13.61 to all complex conjugate 
terms corresponding to pairs m, Mi -\- m where m = Mq + 1, . . . , Mi. Various 
objects will be endowed with the index m = 1, . . . , Mq -\- Mi. Thus we set Sm = 
S{Pm, Om) for m = 1, . . . , Mo and S^ = S{P^, a^) for m = Mq -M, . . . , Mq + Mi. 
The mappings J^ = JKmit^m) '■ Z -^ C^™ are defined for m = l,...,Mo by 
formula (13. lip where /?„ = — In a^. and r^ = K^, + 1. If m = Mq + 1, . . . , Mi, we 
set JmU = {JKmWm)u, JKm{l^m)uy] then Jm : Z -)■ C" where r^ = 2Km + 2. 

It is convenient to rewrite the above results in the vectorial notation. We set 

Mo+Mi 

C^= C^™ (3.15) 

m=l 

and introduce the mapping J : 2 — )■ C^ by the formula 

Jm = (JiM, . . . , iuo+hhuY ■ (3.16) 

The sign-matrix of kernel (11.20 is defined as the block-diagonal matrix 

S = diag{Si,...,SA/o+Afi}- (3.17) 
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It follows from Propositions 13.51 and 13.61 that the sign-function of kernel (11. 2p is 
given by the formula 

Mo+Mi 

{S,\uf) = {SJu,Ju)r = ^ {Sm3mU,3mU)rm- (3.18) 

m=l 

3.2. Below we need the following elementary assertion. We give its proof be- 
cause similar arguments will be used in subs. 3.4 under less trivial circumstances. 

Lemma 3.7. Let /3i,...,/3m ^ C and Ki, . . . ,Km G Z+. Then there ex- 
ist functions ipk,m G Z where m = 1, . . . , M and k = 0, . . . , K^ such that 

^i m(/^") = ^m,nSk,i for all u = 1, . . . , M and I = 0,...,Kjn- 

Proof. Choose some m = 1, . . . ,M and K G Z+. Let oq, ai, . . . ,aK be any given 
numbers. It suffices to construct a function ip G Z such that ip^''\(3n) = for all 
n =^ m and ^''''H/^m) = o,i where I = 0, . . . , K. 

Let ipQ E Z he an arbitrary function such that (po{0) ^ 0. Set oj{z) = 1 if 
M = 1, 

M 

uj{z)= J] {z-fint^^ if M>2, (3.19) 

n=l;n^m 

and 

if{z) = u{z)ipo{z - (3m)- (3.20) 

Of course (p{(3m) 7^ 0. Let us seek the function ip in the form 

^(z) = Qiz - (3mMz) (3.21) 

where 

K 

Q{z) = Y,<l,z' (3.22) 

j=0 

is a polynomial. Clearly, ip E Z and ^ has zeros of order i^ + 1 at all points /5„, 
n y^ m. 

It remains to satisfy the conditions il)^^\(5m) = ai- In view of (I3.2ip . (I3.22p 
they yield the equations 
I 
Y,Clj\q,^^'~^\Pm) = au l = 0,l,...,K, (3.23) 

i=o 

for the coefficients Qj. For / = 0, we find that 

go = v{Pm)~'ao. (3.24) 

Then equation (13.230 determines qi if go, • • • , Qi-i are already found. The corre- 
sponding function (I3.2ip satisfies all necessary conditions. D 



12 D. R. YAFAEV 

Set Um = (wo.m, Mi,m, • • • , UK,n,my € C^^'"+^ for m = 1, . . . , M, u^ = u^ for 
m = 1, . . . , Mq and u^ = (u^, Um+Mi)^ for m = Mq + 1, . . . , Mq + Mi. Then 
Um, G C^™ and u = (ui, . . . , UMo+Ahy is an element of the direct sum (13.151) . Let 
us define the mapping Y : C — t- 2 by the formula 

M Km 
{Y\l){z) = y^^y^^ Uk,m^k,m{z) (3.25) 

m=l k=0 

where ipk,m are the functions constructed in Lemma [XT! We apply this definition 
in the case where /3m = f^m ior m = 1, ..., Mq and (3^ = l^m+Kh > -^m = K^+Mi for 
m = Mq + 1, . . . , Mo + Ml. By the definition of the functions ipk,m, for mapping 
(I3.16P we have the identity 

JY = /. (3.26) 

In view of Theorem 12. 3[ for the proof of Theorem 11.11 we only have to calculate 
the numbers N±{s). This can be reduced to a problem of the linear algebra. 

Lemma 3.8. Let s be the sign-function of kernel (II. 2p . and let S be the corre- 
sponding sign-matrix defined by formula (I3.17p . Then 

N±{s) = N±{S). (3.27) 

Proof. We proceed from identity (I3.18p . Consider, for example, the sign " — ". If 
(s, |Mp) < 0, then (Su, u)^ < for u = Ju. This shows that N_{s) < N_{S). 

Let us prove the opposite inequality. It follows from the identities (I3.18P and 
(I3:26|) that 

(s, |Yup) = (Su, u)j,. 
Thus if (Su, u)r < 0, then (s, Iwp) < for m = Yu. D 

3.3. It remains to calculate the numbers 

Afo+Afi 

iV±(S)= Yl ^±(Sm). (3.28) 

m=l 

It is quite easy to find Nj-{Sm) for m > Mq + 1. 

Lemma 3.9. Under the assumptions of Proposition 13.61 suppose that px y^ 0. 
Then matrix ( J3.14P has exactly K -\- 1 positive and K -\- 1 negative eigenvalues 
{they are opposite to each other). 

Proof Set S = S(P, a) and recall that Det S ^ 0. If S*S/ = X^f for some A > 0, 

then 

g/A/\_/0 S*WA/\_ /A/ 
"^ [±SfJ [S J \±Sf) *^ ^±S/ 

Thus we put into correspondence to every eigenvalue A^ of the matrix S*S of 
order K -\- 1 the eigenvalues A and —A of the matrix S of order 2K + 2. D 
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In the case m < Mq we need some information on skew triangular matrices. We 
consider Hermitian matrices S of order K + 1 with elements Sj^£, j,i = 0, . . . ,K, 
such that Sj^e = s^j. We say that a matrix S is skew triangular if Sj^£ = for 
j + i > K. It is easy to see (reasoning, for example, by induction) that 

Det S = (-l)^(^+i)/2^o,i^si,x-i ■ ■ ■ SK,o. (3.29) 

In particular, Det S* 7^ if (and only if) all skew diagonal elements are not zeros. 
Let us first consider skew diagonal matrices. 

Lemma 3.10. Let Sq be a Hermitian matrix of order K + 1 such that Sj^£ = 
for j + i y^ K. If K is odd, then Sq has the eigenvalues ±\sj^k-j\ where j = 
0,...,{K — l)/2. If K is even, then Sq has the eigenvalues ±\sj^k-j\ where 
j = 0, . . . , K/2 — 1 and the eigenvalue sk/2,k/2- 

Proof. Let us consider the equation 5*0/ = A/ for / = {fo, . . . , fx)^ ■ Since 
Sof = (sck/k, si^K-ifx-i, • • • , SK,ofo)~^ this equation is equivalent to the system 

Sj,K-jfK-j = >^fj, j = 0, . . . , K. (3.30) 

If K is odd, then (I3.30p decouples into {K + l)/2 systems of two equations for /,■ 
and fx-j where j = 0, . . . , {K — l)/2. Every such system has two simple eigen- 
values A = ±y/Sj^K-jSK-j,j = M^j,K~j\- If K is even, then (I3.30p decouples into 
K/2 systems of the same two equations for /,■ and fx-j where j = 0, . . . , K/2 — 1 
and the single equation SK/2,K/2fK/2 = ^fK/2- The last equation has of course 
the eigenvalue A = sk/2,k/2- D 

For applications to Hankel operators, we need the following result. 

Lemma 3.11. Let S be a Hermitian skew triangular matrix of order K + 1 such 
that Sj^K-j 7^ for j = 0, . . . ,K. If K is odd, then S has {K + l)/2 positive and 
[K + l)/2 negative eigenvalues. If K is even, then S has K/2 + 1 positive and 
K/2 negative eigenvalues for SK/2.K/2 > and it has K/2 positive and K/2 + 1 
negative eigenvalues for sk/2,k/2 < 0. 

Proof. According to formula 03.29p . Det S* depends only on elements Sj^i on the 
skew diagonal where j + i = K. Let us use that eigenvalues of S depend contin- 
uously on its matrix elements so that they cannot cross the point zero unless one 
of skew diagonal elements hits the zero. 

Let us consider the family of matrices S{e) where e G [0, 1] with elements 
Sj/{e) = esj^e ioi j + £ < K and Sj/{e) = Sj/ for j + £ > K. Since Det S{e) = 
Det 5 7^ for e G [0, 1], all matrices S{e) and, in particular, S{1) = S and 5'(0), 
have the same numbers of positive and negative eigenvalues. So it remains to 
apply Lemma [3.101 to the matrix S{0). D 

The following result is a particular case of Lemma 13. Ill 
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Lemma 3.12. Let S = S{P,a) be the sign-matrix of kernel ( \3A\\ . (13. 5p where 
Ima = 0, P{t) = P{t) and px ^ 0. The total numbers Af+ = A^+(S) and 
A/"- = N^{S) of strictly positive and negative eigenvalues of the matrix S are 
given by the equalities 

M+=M- = {K + l)/2 if K is odd 
N'+-l=N- = K/2 if K is even and px > 
U+=U--l = K/2 if K is even and pk < 0. 

Combined with equality f l3.28p , Lemmas 13.91 and 13.121 show that 

A/o Mo+Mi 

N^{S) = Y,^±^+ E ^- + ^1- (3-31) 

m=l m=Afo+l 

Putting this result together with relations (12.10p and fl3.27p . we conclude the 
proof of Theorem II. 1[ 

3.4. In this subsection we consider operators H = Hq + V where Hq is the 
Carleman operator (or a more general operator) and ^ is a finite rank Hankel 
operator. Various objects related to the operator Hq will be endowed with the 
index "0", and objects related to the operator V will be endowed with the index 
"f". Our goal is get an explicit formula for the total number N_{H) of negative 
eigenvalues of the operator H. 

Theorem 3.13. Suppose that the sign-function Sq{x) of a Hankel operator Hq is 
bounded and positive. Let the kernel v{t) ofV be given by the formula 

M 



t;(t) = 5^P„(t)e-"" 



m=l 



where Pm{t) is a polynomial of degree Km- Define the numbers J\f_ by formula 
(IL4p where Pm is coefficient (IL3p . Then the total number N^{H) of negative 
eigenvalues of the operator H = Hq + V is given by formula (ll.Sp . 

Comparing Theorem 11.11 for the operator V and Theorem I3.13[ we can state 
the following result. 

Theorem 3.14. Under the assumptions of r/^eorem 13.131 we have 

N_{H) = N4V). 

In particular, H > if and only ifV>0. 

Since for the Carleman operator C the sign-function so{x) = 1, Theorem 13.141 
applies to Hq = C and hence implies Theorem II. 3[ 



ON FINITE RANK HANKEL OPERATORS 15 

The proof of Theorem 13.131 is essentially similar to that of Theorem 11.11 Rela- 
tion (I2.10p remains of course true but instead of (I3.18P we now have 

/oo 
so{x) \u{x)\'^dx + {SyJu, Ju)r. (3.32) 

-oo 

Compared to subs. 3.2, we additionally have to consider the first term in the 
right-hand side of fl3.32p . Instead of Lemma 13. 7[ this requires a more special 
assertion. 

Lemma 3.15. Let /3i, . . . , /3jv/ G C, Ki, . . . , Km G Z_|_ and e > 0. Then there 
exist functions ipk,m{£) € ^ where m = 1, . . . , M and k = 0, . . . , Km such that 
i^ilnil^n] £) = Sm,nSk,i for all H = 1, . . . , M and / = 0, . . . , Km- Moreover, these 
functions satisfy the condition 

/oo 
\iPk,m{x;e)\^dx = Oie), e -> 0. (3.33) 

-oo 

Proof. Choose some m = 1, . . . ,M and K G Z+. Let oq, cti, . . . , a_ft: be any given 
numbers. It suffices to construct a function ijj{e) G Z such that ?/'*■'•* (/3„; e) = 
for a\\ n y^ m and ip^''\j3m'-, s) = cti where I = 0, . . . , K. We also have to satisfy 
condition (I3.33P for the function ip^x^e). 
Instead of (I3.20p we now set 

^{z; e) = co{z)^o{{z - (5m) I e) (3.34) 



where, as in Lemma [3. 7[ y^o G ^ is an arbitrary function such that v5o(0) 7^ and 
ui{z) is function (I3.19p . We again seek the function ip{e) in the form 

i){z]e) = Q{z- I3m]e)if{z]e) (3.35) 

where Q is polynomial (I3.22p with the coefficients qj = qj{e) depending on e. As 
before, ipi^) ^ ^ ^''^^ V^(^) has zeros of order i^ + 1 at all points z„ ioi n ^ m 
and all e > 0. 

The conditions ip^''''{(3m, s) = o-i yield again equations (I3.23p . but now the coeffi- 
cients (f^''~^\f3m', s) depend on e. Note that '^{(3m', £) = (^{(3m)'^o{0) and according 
to (133^1) 

\^^''\f3m;e)\<Cke~''. (3.36) 

The coefficient go is again determined by formula (13.240 : it does not depend on 
e. Solving equations (I3.23p successively for qi{e), . . . , qxi^) and using estimates 
(I3.36P we find that 

\qAe)\<C,6^^, j = 0,...,K (3.37) 
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It follows from (Km . (Km and (lOHjl that, for iV = (K + 1)(M - 1), 
|'?/'(x; e)\'^dx 

-^ roo 

3=0 J-^ 

The integrals in the right-hand side are bounded by Ce^^^^. In view of fl3.37p it 
follows that this expression is 0(e) as e — t- 0. D 

Let us return to Theorem 13.131 Recall that the sign-function of the operator 
H is given by equality fl3.32p . According to Theorem 12.31 and formula fl3.3ip for 
iV_(St;), we only have to check that A^-(s) = A^_(S^). Since sq{x) > 0, we have 
the estimate 

(s, |up) > (StjJu, Ju)r 

which directly implies (cf. the proof of Lemma [3.81) that N_{s) < iV_(S„). 

It remains to check that N^{s) > N^{S^). Let L be the subspace of C 
spanned by the eigenvectors of S^, corresponding to its negative eigenvalues. Then 
dimL = N_(^Sy) and there exists Aq > such that 

(SyU, u),. < — Ao||u||j., Vu G L. (3.38) 

We again define the function u(^e) = Y(£:)u by formula (I3.25P where ipk,m,(^z,e) 
are the functions constructed in Lemma [3. 151 for sufficiently small e. Similarly to 
(I3:26|) . we have JY(e) = I. Since sq G L°°(R), it follows from equality (13321) and 
estimates (I3.33p . (13.380 that 

(s, |M(e)H < -(Ao - Ce)||u||„ Vu G L. 

Choosing Ce < Aq, we see that N_{s) > dimL. This concludes the proof of 
Theorem 13.131 

3.5. It follows from Lemma [3.21 that the b- and s-functions of kernel (11.20 are 
the sums (over m) of terms (13.70 and (13.80 . respectively. The coefficients qk,m of 
the corresponding polynomials Qm{0 ^^^ constructed by formula (13.60 in terms 
of the coefficients p^.m of the polynomials Pmif). 

It turns out that formulas (13. 7p or (13. 8p for the h- or s-functions characterize 
finite rank Hankel operators. Moreover, the coefficients of the polynomials Pm{t) 
are determined by the coefficients of the polynomials QmiO- This follows from 
the assertion below. 

Lemma 3.16. If a function b{^) is defined by formula (13. 7p . then there exists the 
unique polynomial P(t) of degree K such that b(^C,) is the b- function of the kernel 
h{t) = P(t)e~"* where a = e~^ . 
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Proof. Let us solve equations (13. 6p for the coefficients pk where k = K,K — 
1, . . . , 0. Recall that h'k,k = (~1)'^- Therefore according to equation (13.61) where 
k = K we have 



PK = (-l)^«i+^gx 



and, more generally, 



K 



p, = (-l)^ai+^g, - (-1)^ J2 ^k,ea''-W 

i=k+l 

Thus we can successively find all coefficients Pk,Pk-i, ■ ■ ■ ,Po- D 

Since the functions 6(^) and s{x) are obtained from each other by the Fourier 
transform. Lemma 13.161 can be equivalently reformulated in terms of the sign- 
functions. Of course the reconstructions of h{t) by formula (12.91) and by the 
method of Lemma 13.161 are consistent with each other. 

Finally, we state an equivalent assertion in terms of the sign-matrices S (see 
Definition 13.41) . We recall that the sign-matrix S = S(P, a) of the kernel h{t) de- 
fined by (13. 4p . (13.51) is skew triangular and its matrix elements Sj^i = Cl^a~^~^pK 
ii j + i = K. As usual, we suppose that px 7^ 0. Moreover, the matrix S possesses 
an additional property: the numbers 

£!j!s,,, =: p,+„ £,j = 0,l,...,i^, (3.39) 

depend on the sum I + j only. We also note that the matrix S is symmetric if 
a = a and P{t) = P{t). 

The following assertion shows that there is one-to-one correspondence between 
Hankel kernels h{t) = P(t)e~"* and such matrices. 

Lemma 3.17. Let elements sej of a skew triangular matrix S of order K + 1 
satisfy condition (13. 39 p . Then, for every a with Rea > 0, there exists the unique 
polynomial P (t) of degree K such that S = S(P, a) is the sign-matrix of the kernel 
h{t) = P(t)e-°*. 

Proof. Comparing relations (13. 9 p and (I3.39p . we see that q^ = {—l)''k\^^pk. Thus 
it remains to use Lemma [3.161 D 

4. Various representations of Hankel operators 

Hankel operators can be realized in various spaces. We distinguish four repre- 
sentations: in the spaces H^(T), H^(M), /^(Z+) and L'^iR+). The last one was 
already used above. For the precise definitions of the Hardy classes ]H[^(T) and 
]HI^(M), see, e.g., the book |T]. In this text we describe bounded Hankel opera- 
tors in terms of their quadratic forms. Our presentation seems to be somewhat 
different from those in the books [6], [7] . 



18 D. R. YAFAEV 



4.1. Let US start with the representation of Hankel operators in the Hardy 
space H[^(T) C L^(T) of functions analytic in the unit disc. An operator G in 
the space H[^(T) is called Hankel if its quadratic form admits the representation 

(Gm,m)= ui{ij)u{p,)u{fi)din{fi), din{fi) = {27Tifi)~^dfi, Vm G EI^(T), 

Jt 

(4.1) 

where u G L°°{T). Note that din{fi) is the Lebesgue measure on T normalized 

so that m(T) = 1. The operator G is determined by the function uj{fi), that is, 

G = G{u). The function u{fi) is known as the symbol of the Hankel operator 

G(co'). Of course the symbol is not unique because G(aJi) = G(c<;2) if (and only 

if) ui — UJ2 G EI!^(T) (the space of analytic functions outside of the unit disc 

bounded and decaying at infinity). 

Hankel operators in the Hardy space EI^(M) C L^(M) of functions analytic in 

the upper half-plane are defined quite similarly. An operator H in the space 

]HI^(M) is called Hankel if its quadratic form admits the representation 



{Uw,w)= ip{X)w{-X)w{X)dX, VwgH^(M), (4.2) 

Jr 

where ip G L°°(M). The operator H is determined by the function f{X), that is, 
H = ii{(f). The function <f{X) is known as the symbol of the Hankel operator 
H((^). Of course the symbol is not unique because H(y9i) = H(y92) if (and only 
if) (fi — f2& EI5^(R) (the space of bounded analytic functions in the lower half- 
plane). 

In the space /^(Z_|_) of sequences ^ = (^o; ^i; • • •)) ^ Hankel operator G is defined 
via its quadratic form 

oo 

(Ge,0= Yl ""n+mU^n. (4.3) 

n,m=0 

It is first considered on vectors ^ with only a finite number of non-zero compo- 
nents, and it is supposed that 



oo 



Y, ^n+UnL\ < Cll^f. (4.4) 



n,m=0 



Then there exists a bounded operator G such that relation (14.31) holds. We 
note that condition (14. 4p directly implies that x = (xq, xi, . . .) G /^(Z+). Indeed, 
passing from the quadratic form for ^ to the sesquilinear form for ^, rj and choosing 
Tj = (1, 0, 0, . . .), we see that 



Y''nU\<CUl 



n=0 



whence x G P{Z+). 
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Finally in the space L^(M+), a Hankel operator H is defined via its quadratic 
form 

{Hf,f) = {hJ^f) (4.5) 

where / G C^(M+), f -k f is the Laplace convolution (12. ip (note that f -k f E 
C^{R+)) and the distribution h e Co°^(M+)'. If 

\{hJkf)\<C\\fr, (4.6) 



then there exists a bounded operator H such that relation (14. 5 p holds. 
It is easy to see that Hankel operators G, H, G and H are self-adjoint if 



uj{p,) = uj{n), V^(— A) = (p{X), x„ = Hn and h{t) = h{t), 
respectively. 

4.2. Let us establish one-to-one correspondences between the representations 
of Hankel operators in the spaces M^(T), H^(M), /^(Z+) and L'^(R+). Let us 
introduce the notation A('H) for the linear set of all bounded Hankel operators 
acting in one of these four Hilbert spaces H. It is easy to see that H* G A('H) 
together with H and that A('H) is a closed set in the weak operator topology. 

Recall that the function 

C = ^ (4.7) 

determines a conformal mapping z ^-^ ( oi the upper half-plane onto the unit 
disc. The unitary operator U : H^(T) — t- H^(]R) corresponding to this mapping 
is defined by the equality 

{Uu){X) = n-'/\X + ^)-'u{|^). (4.8) 

Making the change of variables (14. 7p in (14. ip , we see that 

G G A(H^(T)) ^^ H = UGU* G A(M^(R)) 

if the symbols a; of G and ip oi H are linked by the formula 

^w=-^^^m- (4-9) 

The unitary mapping J-' : EI^(T) — )■ /^(Z+) corresponds to expanding a function 
in the Fourier series: 

Conversely, for a sequence ^ = {^n}, we have 

oo 
n=0 
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Substituting this expansion into f l4.ip . we see that 

oo 

{GU,U)= ^ >Cn+m^mL (4-10) 

n,m=0 

where 

x„ = {J^u)n, n e Z+. (4.11) 

If w G L°°{T), then expression fl4.10p satisfies estimate fl4.4p . and hence the op- 
erator G defined by relation (14.30 is bounded. Thus the inclusion G G A(H^(T)) 
implies that G = J^G7* G k{f{Z+)). 

Conversely, according to the Nehari theorem (see the original paper [S], or the 
books [6J, Chapter 1, §1 or [^, Chapter 1, §2) under assumption (14.41) there exists 
a function uj G L°°(T) such that equalities (14. lip hold. Hence the operator G 
defined by relation (I4.10p satisfies also ( Hll) . Thus for every G G k{f{'L+)) the 
operator G = J^*GJ^ G A(M^(T)). 

To show that the inclusions H G A(e^(R)) and H = <I>H<I>* G A{L'^(R+)) are 
equivalent, we need the continuous version of the Nehari theorem. We give only 
its brief proof referring to subs. 3.2 of [lOj for details. 

Proposition 4.1. Let h G G^{W^y. Then estimate (14.61) is satisfied if and only 
if there exists a function ip G L°°(R) such that 

h = (27r)"^/2$^. (4.12) 

In this case 

ff = $H$* (4.13) 

where H is the Hankel operator in the space EI^(]R) with symbol ip. 

Proof. Let (14.120 hold true. Passing to the Fourier transforms, we see that 

{h, f^f) = V2^{^*h, w, w), V/ G Co~(M+), w = $7, V/i G S', (4.14) 

where w*(A) = w{—X). Under assumption (I4.12p the right-hand sides here and in 
(14. 2 p coincide, and estimate (14. 6 p is true ii p e L°°(R.). Equality (14.140 implies 

Conversely, let (14. 6 p be satisfied so that there exists a bounded operator H 
satisfying relation (14. 5p . Define the shift T{t), r > 0, in the space L^(R_|_): 
(T(r)/)(t) = f{t-T). Observe that (T(r)/)*/ = f*{T{T)f) whence HtIt) = 
T{t)*H for all r > 0. It follows that HY. = E*H where 

S = -2 / T{T)e-^dT or (S/)(t) = -2e"* / e'f{s)ds. (4.15) 

Jo Jo 

Passing to the Fourier transforms, we see that the operator H = $*iJ$ satisfies 

the commutation relation 

HE = E*H (4.16) 
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where according to the second equahty (I4.15P , S is the operator of multiphcation 
by the function (A — z)(A + i)~^ in the space H[^(]R). Translating the Nehari 
theorem from the space H[^(T) into EI^(M), we see that relation fl4.16p implies 
that H is a Hankel operator with symbol (/? G L°°(R). D 

Finally, we note that the representations in the spaces /^(Z+) and L^(]R_|_) can 
be directly connected by the unitary operator £ constructed in terms of the 
Laguerre functions. But we not need this construction here. 

The relations between different representations can be summarized by the fol- 
lowing diagrams: 






-^ w{X) = {Uu){v) 






U 






(4.17) 



-f fit) = {<l>w){t) 12 (^) _^ ^2/ 



^+J 



and 



G 



^ H = UGU* 



^(/^) > vW 



(4.18) 



G = J^G7* 



-^ H = $H$* 



x„. 



-^ h{t) 



Of course, the unitary transformations J-", W, $ and C realizing isomorphisms in 
(I4.17P are not unique. We can compose each of them with an automorphism of the 
corresponding set of Hankel operators A('H). The group G('H) of automorphisms 
of the set A('H) will be described in the Appendix. 



5. Finite rank Hankel operators in the spaces 
H^(R), H^(T) AND /2(Z+) 

Here we reformulate Theorems 11.11 and 11.31 in terms of Hankel operators acting 
in the Hardy spaces EI^(]R) and EI^(T) of analytic functions and in the space 
of sequences /^(Z+). We proceed from relations between various representations 
described in Section 4. Now we have to specify diagrams (I4.18P for finite rank 
Hankel operators. 

5.1. Originally, the Kronecker theorem was formulated in the space /^(Z+) 
(see the paper [3] or the book [6], Theorem 3.1 in Chapter 1). It states that, for 
a Hankel operator G of rank r determined by the sequence x„, the function 



a;(C) = Y. ^"C" 



(5.1) 



n=0 



is rational, i.e., uj{Q = V{CjQ{C) ^ where 'P(C) and Q(C) are polynomials of 
degrees degP < r — 1 and deg Q < r. Since u G Eli(T), its poles lie outside 
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of the unit disc. It follows that for some numbers 7^ G C and Km G Z+, 
m = 2, . . . , M, function (15. ip admits the representation 



M 
m=2 



(C) = i?i(C) + Y. ^-(C)(C - 7™)"'"'^"', hm\ > 1, RmilJ 7^ for m > 2, 

(5.2) 



where all RmiC) ^^^ polynomials and degi?^ < -^m for m > 2. Note that 



M 



rank G = deg i?i + J^ K„ + M. 



m=2 

If G is a finite rank Hankel operator in the space EI^(T), then we can apply 
the Kronecker theorem to the operator G = J-'GJ-'* acting in /^(Z_(_). Hence a 
symbol uj{() of G can be chosen in the form (15. 2p . 

Similarly, a symbol <f{z) of a finite rank Hankel operator H in the space EI^(]R) 
can be chosen in the form 

M 

cp{z) = YQmiz)iam-tzy^"'~\ Rea^>0, Q™(-ia^) 7^ 0, (5.3) 

m=l 

where Qm{z) are polynomials and degQm < Km- The relation between symbols 
(15. 2p and (15. 3p of the operators G and H = lAGlA* is given by formula (14. 9p . In 
particular, we have 

_ 7m + 1 

and 

gi(-z) = (-l)^^2^^+i-^i?f ^\ iri = degi?i, ai = l, 

Ki\ (5.4) 

^m\ ^"mj ■^ 7mw»n ^) ^m\(m) i "m 7^ -'-• 

Since 

/oo 
(a - i2)-^-^e-^^*rfz = 27rt^e-"*, Re a > 0, 
-oo 

the operator H = $H$* acts by formula (II. ip and has kernel (II. 2p where Pm{t) 
is a polynomial of degree Km and 

^if'"^ = Qm(-^am). (5.5) 

Thus, as stated in the Introduction, all finite rank Hankel operators in the space 
L^(M+) are given by formulas (II. ip . (II. 2p . 

Finally, for a finite rank Hankel operator G in the space /^(Z+), the operator 
G = J^*GJ-' has symbol (15. 2p . Expanding this function into the Fourier series 
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and using relation (14. lip , we find that 

M 

Xn = T„ + ^ Tmin)q'^, \qm\ < 1, (5.6) 

m=2 

where r„ = for n > Ki + 1 and T^ are polynomials of degree Kj^. We note that 
Qm = 7m and 

K^\TJ,, = Rf^\ Tif-) = (-l)^-+ig^-+ii?(7^). (5.7) 

Let us now consider the self-adjoint case. If G = G* and the sum in (15. 2p 
contains a term with 7^, then necessarily it also contains the term with 7^. 
We suppose that Im7m = for m = 2, . . . , Mq and Im7m < 0, 'jMi+m = 7m 
for m = Mo + 1, . . . , Mo + Mi. Then RmiC) = Rm{C) for m = 1, . . . , Mo and 

i?Mi+m(C) = ^m(C) for m = Mo + 1, . . . , Mo + Mi. 

Similarly, if H = H* and the sum in (15.31) contains a term with am, then 
necessarily it also contains the term with am- We again suppose that lm.am = 
for m = 1, . . . , Mo and Im a^ > 0, aM^+m = C(m for m = Mq + 1, . . . , Mq + Mi. 
Then Qm{z) = Qm{-z) for m = 1, . . . ,Mq and QMi+m{z) = Qm{-z) for m = 
Mo + 1,..., Mo + Ml. 

Finally, if G = G*, then necessarily r„ = x„ and if the sum in (15.61) contains a 
term Tm,(n)g^, then it also contains the term Tm{n)q!^. We suppose that Img^ = 
for m = 2, . . . , Mo, Im g^ > for m = Mq + 1, . . . , Mq + Mi and qMi+m = Qm 
for m = Mq + 1, . . . , Mq + Mi. The coefficients of the polynomials T^ for m = 
2, . . . , Mo are of course real. 

5.2. Now we are in a position to reformulate Theorems 11.11 and 11.31 in various 
representations of Hankel operators. Recall that the numbers Pm were defined 
by formula (II. 3p . Let us start with finite rank Hankel operators H in the space 
EI^(M). Given the one-to-one correspondence between Hankel operators with 
kernels (11.21) and symbols (15.31) and, in particular, equality (15.51) . the following 
result is equivalent to Theorem 11.11 

Theorem 5.1. Let the symbol of a self-adjoint Hankel operator H in the space 
EI^(R) be given by formula (15. 3p where Qm{,z) are polynomials of degree deg Qm < 

Km- Let the numbers A/"], be defined by formula (ll.4p where Pm = Qmi—icum)- 
Then the total numbers A^-i-(H) of (strictly) positive and negative eigenvalues of 
the operator H are given by the formula (II. 5p . 

In particular (cf. Corollary 11.21) . H > (H < 0) if and only if all poles of its 
symbol lie on the imaginary axis, are simple, the real parts of the residues are 
equal to zero and their imaginary parts are positive (negative). 

Note also that according to (I4.12p the symbol of the Carleman operator can 
be chosen as ipQ^X) = irisgnX. Therefore the next result is a direct consequence 
of Theorem 11.31 
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Theorem 5.2. Let H be the Hankel operator with symbol vrisgn A + ^{\) where 
V9(A) IS function f l5.3p . Then the total number N_{ii) of its negative eigenvalues 
is given by formula (11. 5p . 

Quite similarly, given the one-to-one correspondence between Hankel operators 
with symbols (15. 2p and (15. 3p and, in particular, equalities (15 .4^ . the following 
result is equivalent to Theorem 15.11 

Theorem 5.3. Let the symbol of a self-adjoint Hankel operator G in the space 
HI^(T) be given by formula (15. 2p where Rm{0 '^i"^ polynomials of degree deg Rm < 
Kjn- Let the numbers M^ be defined by formula (11.41) where 

Pi = i?S^'^ and p„ = -Rm{lm) sgn 7^ if m = 2, . . . , Mq. 

Then the total numbers A^±(G) of [strictly) positive and negative eigenvalues of 
the operator G are given by the formula (11.51) [if Ri{() = 0, then the first sum 
in (11.51) starts with m = 2). 

In particular (cf. Corollary II. 2p . G > ( G < 0) if and only if all poles of its 
symbol lie on the real axis, are simple and the residues are positive (negative); 
moreover, it is required that deg_Ri = and Ri>0 (Ri < 0). 

Theorem 15.21 can also be reformulated in an obvious way in terms of Hankel 
operators in the space EI^(T). 

Theorem 5.4. Let G be the Hankel operator with symbol 7ri//~^ sgnlm/i + uj{fi) 
where u{n) is function (15.21) . Then the total number N_{G) of its negative eigen- 
values is given by formula (II. 5p . 

Finally, we use the one-to-one correspondence between Hankel operators with 
symbols (15.21) and with matrix elements (15.60 and, in particular, equalities (15. 7p . 
Therefore the following result is equivalent to Theorem | 



Theorem 5.5. Let G be a finite rank Hankel operator in the space L'^{'Z^) with 
matrix elements (15. 6p where t„ = for n > Ki, tk^ 7^ and Tm are polynomials 
of degree Km- Let the numbers J\f^ be defined by formula (II. 4p where 

Pi = TK, and Pm = TJ^^^ if m = 2,...,Mo. 

Then the total numbers N±{G) of (strictly) positive and negative eigenvalues of 
the operator G are given by the formula (II. 5p {if Tn = for all n > 0, then the 
first sum in (II. 5p starts with m = 2). 

In particular (cf. Corollary II. 2p . G > ( G < 0) if and only if 

A/o 

>fn = ti6nfl + "^ trnQm, Qm G ("1, 1), 
m=2 

where all numbers ti, . . . , tjno are positive (negative). 
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Theorem 15.41 can also be reformulated in an obvious way in terms of operators 
in the space /^(Z,+) if one takes into account that the matrix elements of the 
Carleman operator equal x„ = 2(n + 1)^^ for n even and Xn = for n odd. 

Theorem 5.6. Let G be the Hankel operator in the space /^(Z+) with matrix 
elements Xn + Xn where the numbers Kn are defined by formula (15. 6p . Then the 
total number N^ (G) of its negative eigenvalues is given by formula ( \1.5\\ . 

Appendix A. The automorphism group of Hankel operators 

A.l. Let 1-L be one of the spaces e^(M), L2(M+), H^(T) or /^(Z+). Our 
goal here is to describe the group G(7{) of all automorphisms of the set A('H) of 
Hankel operators in "H. By definition, a unitary operator U G Q{l-i) if and only 
if UHU* e A('H) for all H G A('H). Of course, for a Hankel operator H and 
an arbitrary unitary operator f/, the operator UHU* is not necessarily Hankel. 
Hence the group Q{'H) is smaller than the group of all unitary operators. It turns 
out that this group admits a simple description. 

It is sufficient to describe G{V,) for one of the spaces H^(M), L2(M+), H^(T) or 
/^(Z+). We choose "H = EI^(R). Then other groups are obtained by conjugations 
with the unitary transformations $,W* and T: 

G(L2(M+)) = $G(M^(R))$*, 

G(e^(T)) =W*G(H^(M))W, 

G(Z2(Z+)) = J^G(H^(T))J^*. 



Let us define the dilation operators Dp, p > 0, in the space H^ 

(D,«)(A) = pV2^(pA). 

Obviously, the operators Dp are unitary. Set 

iXu){\) =iX-^u{-\-^). 

Then X : EI^(M) — )■ E[^(M), X is the involution, i.e. X = X , and X is also unitary. 
It is easy to see that 

DpH(v9)D; = H(<^p) and XH(<^)X* = H(<^) (A.l) 

where v^p(A) = ip{pX) and <^(A) = {p{—X~^). In particular. Dp G G(EI^(R)) and 
X G G(H^(M)). It turns out that the group G(H^(M)) is exhausted by these 
transformations. Let us state the precise result. 

Theorem A.l. A unitary operator U G G(EI^(R)) if and only if it has one of 
the two forms: U = 6'Dp or U = 0DpX for some 6' G T and p > 0. 

Actually, we shall prove a stronger statement. 
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Theorem A. 2. Let Hq, be the Hankel operator in the space EI^(R) with symbol 
VaW = 2a{a — iX)~^. Suppose that an operator U is unitary and UHq,U* G 
A(e^(R)) for alia > 0. Then either U = OBp or V = OB^L for some 9 eT 
and p > 0. 

Proof Set U = $U$* and H^ = $Hc,$*. It follows from formula (021) that H^ 
is the Hankel operator in the space L^(R_|_) with kernel ha{t) = 2ae~°*, that is, 
Haf = {f,i^a)i^a where 

iJa{t) = v^e""*. (A.2) 

By our assumption, the operator UHqU* G A(L^(M+)). It has rank one, and its 
non-zero eigenvalue equals 1. By the Kronecker theorem, all rank one Hankel 
operators have kernels pe~^^ for some p, /3 G C with Re/3 > 0. They are self- 
adjoint and have the eigenvalue 1 if and only if /3 > and p = ^/2^. Therefore 

UHaU* = Hp 

and hence 

for all / G L^(R_|_) and some /3 = v{a). It follows that 

?7V'a = ^(«)V^.(a), |^(«)| = 1. (A.3) 

We have to find the functions 9{q) and v{a). Let us take the unitarity of U 
into account. Since {U'ipa^,Uipa2) = {'4^ai,4'a2)y relation flA.SP implies that 



0{ai)e{a2){ipv{ai),'ipv{a2)) = ii^aij-ipaz), Vai,a2>0. (A.4) 



Note that ^Q,(t) > for all a > and t > and hence 6{ai)9{a2) > 0. Using 
also that |^(a)| = 1, we see that 6{a) = 6{1) for all a > 0; thus 6{a) =: 9 does 
not depend on a. Returning to (1A.4P and using the explicit expression (1A.2P for 
ipa(t), we obtain the equation 

\/v{ai)v{a2) _ A/aia2 . . . 

v{ai)+v{a2) «! + ^2 
Set here ai = 1, 0^2 = a. Equation flA.SP for v{a) has two solutions 
v{a) = v{l)a and v{a) = v{l)a~^. 
It now follows from (]A.3|) that 

Utpa = d^p-^a or U^a = 0'ip(^pa)-l 

where p = v{l)^^. Since ^Lpa = 2y/7ia'ipa, these equalities can be rewritten as 

\Jipa = Oy/pipp~i^ or \Jipo, = 9ay/pip(^pa-)-i. (A.6) 

Note that 

DpV^a = i/PV^p-ia and Xv9„ = avj^-i- 
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Hence (1A.6I) are equivalent to the equalities 

UiPa = Q^p^a or \JiPa = O^fXfa, V« > 0. 

It remains to extend these relations to the whole space EI^(M). To that end, 
we have to show that the set of the functions ipa where a > is arbitrary is dense 
in H[^(M) or, equivalently, that the set of the functions tpa is dense in L^(R+). 
Set 

(L/)(t) = / e-°V(a)rfa. 

This operator is self-adjoint and bounded in the space L^(M+). It has purely 
absolutely continuous spectrum (see, e.g., p]). Therefore its range is dense in 

L2(M+). d 

A. 2. Let us now describe the group G('H) in other representations of the space 
"H. In view of Theorem lA.lt to that end we only have to calculate the operators 

Wp = WT>pU, Dp = <l>Dp$*, Wp = TWpJ^* 

and 

acting in the spaces EI^(T), L^(]R+), /^(Z+), respectively. 
According to formula (14. 8 p we have 

(Wp/)(/i) = ^,(^/(^g)S), r{p) = J^ e (-1, 1), 
and 

W)(/i) = /(-/i)- (A.7) 

The role of (lA.ip is now played by the relations 



WpG{uj)W; = G{up) and JG{uj)J* = G{u) 

where 

Upifi) = w(igg^) and u{fi) = w(-/i). 

The operator Dp is again the dilation, {Dpf){t) = p^^/'^ f{p^^t), and for a 
Hankel operator H with kernel h{t), the operator DpHD* has kernel hp{t) = 
h{p~^t). Apparently there is no simple formula for the operator X. 

It follows from (1A.7P that {JC)n = {—^)"'Cn, and for a Hankel operator G with 
matrix elements x„, the operator JGJ* has matrix elements {—l)'^>Cn- On the 
contrary, there seems to be no direct expression for the operators Wp. 
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